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(57) Abstract 

^ A memod of transniittmg ti^ critical data via an asyndmmous channel Tbc timing critical data can be an MPEG transport stream 
o f packe ts,JIbe asynchronous channel can be a computer or tele|^one nctwoA, a digital stora^ media sudi as a digital VCR. oTa digital 
intoftoe^Thc i»ckets are procened serially tfanxigh a remuxer to obtab a ccmstant rate and delivered to and consumed by one cffmote 
tar^ dccodea^ffor example, mside a TV set or in a set-top decoder. To prevent overflow of the transport buffera inside these decodeis a 
smglc mcmyr-scteduler is provided whit* monitors the transport buffers and deUveis to each the packets wanted scheduled so as to avoid 
buffer overflow and loss of mfonnation. The mediod also includes restaraping the transport packer widi new PCRs. Tbe remuxing sdieme 
L- ,jnplc enough to miplemem on DVCR or oth» consumer applicaiicms. Also described is a method f or recoiding the output sn^ which 
selects out desired program matenal and tags the transport packets widi SOA tags. 
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MPEG information signal conversion system. 



RELATED APPUCATIONS 

This application is a continuation-in-part of conunonly-assigned application. 
Serial No. 08/253,535, filed 6/3/94, entiUed "Reconling And Repnxlucing An MPEG 
Infomation Signal On/From A Record Carrier" in the names of R.W.J J. Sadjs, I.A. Shah 
5 and Takashi Sato, which is in turn a continuation-in-part of commonly-assigned application. 
Serial No. 08/225,193, filed April 8, 1994, entiOed "Recording And Reproducing An MPEG 
Information Signal On/From A Record Carrier" in the names of W.J. Van Gestel, R.W.J.J. 
Saeijs and I.A. Shah. 

10 BACKGROUND OF THE INVENTION 

The invention relates to a system for recording and playing back an MPEG 
information signal in tracks on a record carrier, and specifically a record carrier of the 
Digital Video Cassette Recorder (DVCR) type. 

An MPEG information signal comprises a succession or stream of tian^rt 
15 packets, which includes a data compressed digital video signal and a corresponding data 
compressed digital audio signal (and sometimes data signals), for broadcasting purposes or 
for transmission via a cable network. The MPEG information signal is in the form of 
transpon packets having either an equal length or a variable length in time. In both cases, 
however, a transport packet comprises 188 bytes of information, the first byte of which is a 
20 synchronization byte. 

A transmission such as an MPEG information signal in tiie form for recording 
on and reproduction from a record carrier, such as a magnetic record carrier as a tape, 
require special measures to be taken in order to realize such kind of transmission via the 
known tape format 

25 Storing a packet sequoice number has its advantages if an MPEG data stream is 

received having a constant bit or transpon rate without any gaps between packets, and 
comprising a number of different video programs interleaved in the MPEG data stream. 
Generally, such data stream may have too high a bit rate for recording the total data stream 
on the record carrier. For example, the MPEG bit rate for cable transmission is 45 Mbps, 
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whereas the record carrier typically records with a 25 Mbps bit rate. The recording 
arrangement now comprises a program selector for retrieving one or multiple programs from 
the MPEG data stream so as to obtain the MPEG information signal for recording. As 
information corresponding to only one program is included in a MPEG transport packet, 
such a program selector selects, which is per se known, only those transport packets from 
the MPEG data stream that comprise information corresponding to wanted program(s). lliat 
means that some packets of the original MPEG data stream received are deleted. Upon 
reproduction, however, a valid MPEG video signal in accordance with the MPEG standard, 
however now comprising only the wanted programs, must be regmerated or recreated. By a 
"valid- MPEG signal or transport stream is meant a stream that satisfies the following 
requirements: 

1 . The program clock reference (PGR) in the packet is OK. The PGR is, 
typically, a 33 bit value of a sample of the local clock in the transmitter encoder. The PGR 
is used for clock recovery so that in the decoder, the local clock can be sync'd to the 
encoder local clock. 

2. Accumulated change to each PGR through the network must be kept within 
the limit specified by MPEG. 

3. The decoder transport buffers do not overflow. 

Such regenerated data stream should have the transport packets that were 
selected upon recording in the same order. Upon recording a sequence number can be added 
to each transport packet received, also for any packets that will be deleted. The sequence 
numbers of the packets that are selected and stored may be stored in the third block section 
of the signal blocks in which a transport packet is stored. Upon reproduction, a sequence of 
numbers is retrieved, where subsequent numbers will not necessarily be next higher numbers. 
In that situation one or more dummy packets must be inserted so as to regenerate the replica 
of the original MPEG data stream. 

It will also t>e apparent that a reproducing arrangement will be needed which is 
adapted to each specific embodiment of die recording arrangement, so as to enable a 
reproduction of the MPEG information signal recorded on the record carrier. 

The two related copending applications, whose full contents are incorporated 
herein by reference, describe such systems which solve a problem arising from the 
asychronous nature of a channel represented by the DVCR and the necessity for preserving 
the timing critical data incorporated in the MPEG transport stream so that it can be 
reconstituted as a valid MPEG information signal upon playback for reproduction on a 
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conventional TV set. The systems described involve tagging transport packets of the MPEG 
data stream, before inputting to the channel, with timing information, and using the timing 
information at the output end of the channel to recreate the proper data timing. Various 
schemes are described for packing the timing information tags with each or a plurality of 
transmission units of the transport stream. Using this basic tagging mechanism, transport 
streams of various types can be recorded and played back without losing any of the 
information in the original transmission* Where the transport rate of the transport stream is 
unknown, or with gaps between the transport packets (i.e., bursty), or the transport rate 
changes, then the referenced related applications describe ways of handling such data 
streams. 

When, on the other hand, the tran^n rate of the incoming transport stream is 
constant and unknown, the related applications also describe schemes for handling this 
situation. Thus, using a combination of Time-Of-Arrival (TOA) and Sequence-Of-Arrival 
(SOA) tagging as described in the related applications, an MPEG-2 transport stream of 
unknown but constant transport rate can be recorded and recreated on playback. In this case, 
however, there must not be any gaps between the transport packets at the input, 

BRIEF SUMMARY OF THE INVENTION 

An object of the invention is a system for recording and playback of MPEG 
information using a DVCR. 

A further object of the invention is a system for generating a fixed-rate, 
constant transport stream from an incoming unknown transport stream, which is possibly at 
varying rate, . and/or bursty . 

Another object of the invention is a system for generating a fixed-rate, constant 
valid MPEG transport stream fiom an incoming unknown MPEG transport stream, whidi is 
possibly ai varying r^, and/or bursty. 

Still another object of the invention is a remuxing scheme for MPEG transport 
streams which is simple enough to implement in DVCR or other consumer applications. 

In accordance with one aspect of the invention, the pack^ are processed 
serially through a remuxer to obtain a constant rate and delivered to and consumed by cme or 
more target decoders, for example, inside a TV set or in a set-top decoder. To prevent 
overflow of the transport buffers inside eadi of these decodos, a single monitor is provided 
which monitors all of the transport buffers and delivers to each the packets wanted timed in a 
manner that will avoid buffer overflow and loss pf information. This aspect of the method of 



>_eeoeiieAijL> 



wo 96/08115 PCT/IB95mm5 

4 

the invention requires that the transport packets be restamped with a new PCR. Looked at 
from another view, this aspect of the invCTtion basically involves remuxing the transport 
stream to a known and fixed case, and then applying the solution described in the referenced 
related applications for the case of a transport stream with a constant and known transport 
S rate. 

The invention is not limited to application to an MPEG information signal and 
can also be applied to asychronous channels other than a DVCR. In addition to transmitting 
MPEG data streams, there are various other ^plications that may require the transmission of 
timing critical data over an asynchronous channel. Asynchronous here means that the 
10 physical data rate of the channel is different from the transpon rate, the rate of the data to be 
transmitted, so that the bitwise timing of data is not maintained through the channel 
transmission* 

In the MPEG transport stream as an example of timing critical data, the relative 
arrival time of a datum which r^resents timing information of the transport stream, i.e., the 

IS PCR, must not be changed beyond a specified tolerance through transmission without 

changing the PCR value accordingly. This is because otherwise, the Phase Lock Loop (PLL) 
circuitry of a decoder will fail to regenerate the data clock, and the buffers may 
under/overflow. This problem of how to transmit timing critical data over an asynchronous 
channel without changing any datum to be transmitted also exists where the asynchronous 

20 channel is a computer network, a telephone network or a digital interface, e.g. P1394. 

In accordance with another aspect of the invention, an improved remux method 
is described which does not have to perform complex de-multiplexing/re-multiplexing but 
relies instead on scheduling each packet without changing the order of the usefiil packets. 
This method offers the important advantage that the required hardware is much less 

25 expensive and thus easier to implement in low-cost consumer equipment. 

The various features of novelty which characterize the invoition are pointed out 
with particularity in the claims annexed to and forming a part of this disclosure. For a better 
understanding of the invention, its operating advantages and specific objects attained by its 
use, reference should be had to the accompanying drawings and descriptive matter in which 

30 there are illustrated and described the preferred embodiments of the invmtion, whemn like 
reference numerals depict the same or similar components. 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings: 
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Fig. 1 corresponds to Fig. 18 of the second related application and shows a 
system for handling a transport stream with a known and constant transport rate, ^m both 
the recording and playback standpoints; 

Fig. 2 shows an example of the input and output data streams from the 
apparatus of Fig. 1; 

Fig. 3 illustrates a remuxing and DVCR recording system; 

Fig. 4 shows an example of the input and output data streams from the 
apparatus of Fig. 3; 

Fig. S is a schematic block diagram of a packet processor feeding apparatus 
with a target decoder; 

Fig. 6 is a block diagram of one form of remuxing system in accordance with 
the invention; 

Fig. 7 is a block diagram combining the system of Fig. 1 and the remuxing 
system of Fig. 6 as one form of another embodiment of the invention; 

Figs. 8A and 8B are graphs illustrating the effects of a remuxing scheme which 
does not monitor the transport buffer under two different conditions; 

Figs. 9A and 9B are graphs illustrating the effects of a remuxing scheme which 
does monitor the transport buffer under the same two different conditions of Figs. 8 A and 
8B. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In order to better understand the invration, we will first describe the system 
described and claimed in the two related applications for handling a transport stream with a 
constant, known transport rate. 

Fig. 1 shows such a system applied to an MPEG application where R represmts 
the transport rate of the MPEG data stream subdivided into transmission units in the form of 
a successim of transport packets from a digital inter&ce (D-I/F). In the example given, the 
incoming transport rate is 43 Mbps, to be recorded on a DVCR at 2S Mbps, and then 
recreated as a valid MPEG signal at 45 Mbps, for playback on a standard TV set 

The incoming data stream from D-I/F is received by a known tagging means 10 
for tagging each incoming packet with a SO A tag requiring only a counter 11 incrementing at 
the arrival of each transport packet The tagged packets then go to a selection means 12 for 
selecting the desired program material, and the selected packets stored temporarily in a local 
buffer IS. As explained in the refermced related plications, trickmode packets can be 
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gmerated from the incoming transport stream at block 16 and intermixed with the desired 
program material by a MUX block 17 at the desired transport rate for recording on the 
DVCR. The tagging bits are recorded onto the DVCR tape along with the corresponding 
transport packets using the extra bits available from the 2 to S sync blocks mapping as 
5 described in the related cases. 

On playback, each recorded packet is read out at its correct sequmce according 
to the SOA stamp information under control of a read control block 20 via a local buffer 22. 
A DE-MUX block 21 acts to sqiarate the packet stream, and the gaps formed by the non- 
selected program material packets in the ou^ut stream are filled in by supplying Null packets 

10 from a Null packet generator 23. During playback, each time a "discontinuity" in the SOA 
tag is detected, it is assumed to have come from a transpon packet that has not been 
recorded. These ''missing" packets are replaced with the Null packets. All transport packets 
are thus output at the known and constant transport rate. 

Fig. 2 gives an example of the transport stream resulting. In the upper 

IS diagram, as an example, the input transport stream is a two program stream: programs A 
and B. We wish to record only program A, and hence strip out the B packets in the 
selection block 12. On playback, all the packets belonging to program A are reproduced at 
precisely their original times and rates, and the gaps are filled in with the Null packets 
(lower diagram). If the input stream was a valid MPEG signal, the output stream will also be 

20 vaUd. 

As will be clear from the foregoing explanations, to maintain the 
interoperability between MPEG applications, it is necessary for the DVCR to generate a 
valid MPEG transport stream, preferably at a fixed-rate and constant (i.e., without any gaps 
between packets). Generating a fixed*rate constant transport stream for input to the 

25 apparatus of Fig. 1 from an incoming unknown transport stream, which is possibly at 

varying rate and/or bursty, meaning that there are gaps between the packets, is equivalent to 
generating a new transport stream by so-called remuxing. Remuxing by DVCR is comprised 
of selection of necessary packets, rescheduling of the timing of each pack^ and multiplexing 
of the selected packets with Null pack^ to fill out the gaps in the transport stream. 

30 Whenever remuxing is done, the following remux requirements must be met: 

(a) Timing jitter of each PGR (incorporated in each transport packet) must be 
l^t within an acceptable limit. 

(b) Accumulated change to each PGR through the network must be k^ wittiin 
the limit specified by MPEG. 
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(c) Generated transport stream must not overflow the transport buffer of each 
elementary stream decoder. 

One form of apparatus according to the invention is illustrated in Fig. 3, a 
combination of SOA and remuxing. In this case, after the remuxing 80, the packet stream at 
the new rate is tagged 81 and any NuU packets removed in the local buffer block 82. 
However, in this case, the duration of the output packets is different. Fig. 4 shows in the 
upper diagram the input stream to the remuxer 80, and in the lower diagram the output 
stream to the D-I/F. The transport rate is now constant, but the packets need restamping 
with new PCRs because the old PCRs are no longer valid. Another problem appears, 
illustrated in Fig. S. 

Fig, 5 shows schematically a valid MPEG signal input to a packet processor 84, 
which may be the system of Figs. 1 and 3. It ouQ>uts a valid transport stream like that of 
Fig. 4 Oower diagram) to, for example, a selector 86 selecting packets for each elementary 
stream decoder 85 which includes a transport buffer 87, referred to herein as the "target 
decoder" and "target buffer". For the system to perform properly, the target buffws of each 
decoder provided must all be managed to avoid overflow. The problems arc illustrated in 
Figs. 8A and SB. 

In these figures, X represents the input transport rate, Y represents the output 
transport rate, and R represents the read-out or emptying or leak rate of the transport buffer 
in the target decoder. Fig. 8A shows the effect of remuxing without monitoring of the 
transport buffer where R < Y < X. The row labelled Input is the sequence of input 
transpon packets, and the row below labelled ou^ut is the sequence of outptii transport 
packets over a time t. The graph above indicates the fullness of the transport buffer over 
time t, with the dashed line 29 at top labelled Th representing a full buffer, and the dotted 
diagonal lines 30 rq>resenting the input stream. Where the solid line curve 31 representing 
the output stream crosses the threshold line 29, shown at 32, bits of certain output packets 
will be lost, which will occur with packets 7, 10, etc. The case illustrated is where the 
input rate is faster than the ouq>ut rate. 

in Fig. 8B, the case where the input rate is slower than the output rate is given, 
represented by R < X < Y, with the doted lin^ 34 again representing the input stream, and 
the solid line curve 35 again rqsresenting the output stream. Here, too, without monitoring, 
when the curve 35 crosses the threshold line 29, shown at 36 and 37, bits of certain output 
packets will be lost, which will occur with pack^ 6, 9, etc. 

A feature of the invration is a runuxing scheme for MPEG transport streams 
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which is simple enough to implement on DVCR or other consumer applications. 

This aspect of the present invention is based upon the following new concepts 
and understandings. 

1 . Incoming transport streams have small enough timing jitter; hence, 

5 requirement (a) can be met simply by restampiog PCR's, using an appropriate local clock. 

2. Incoming transport streams have enough head room for the PGR change; 
hence, the requirement (b) can be met by the remuxing scheme described bdow. By "head 
room" is meant the unused portion of the limit as defined in the MPEG standard. 

General remuxing includes clock regeneration of each program, de-multiplexing 
10 of the input to sqiarate each elementary stream, keeping track of each transport target buffer, 
calculation of a new schedule, re-multiplexing of the elementary streams, restamping of 
PGR, and so on. As will be recognized, such general remuxing requires complex software 
and hardware not implementable in typical low-cost consumer appliances. A feature of our 
invention is based on a simpler remuxing scheme, which does not perform de- 
15 muluplexing/re-multiplexing but simply schedules each transport packet without changing the 
order of the useful packets. This approach requires certain basic assumptions: 

1 . The total net rate of the wanted program(s) in the input transport stream must 
be less than the output transport stream rate (the remux rate); 

2. The input transport stream rate can, however, be unknown, bursty and/or at 
20 any rate, higher or lower; 

3. The remux rate is known, fixed and constant. 

In accordance with an aspect of the method of the present invention, the 
remuxing goes as follows, reference being made to Fig. 6 which is a block diagram of one 
form of remuxing s4>paratus in accordance with the invention: 
25 1. The necessary packets are selected from the incoming transport stream by a 

filter or selector 40. 

2. The packets containing the PGR are tagged 41 with the sampled value of a 
local clock 39. 

3. Each packet is stored and kept in a local buffer 42 until it is read out to a 
30 packet store 44. 

4. Whenever the packet store 44 is empty and there is at least one p ?r kr t in die 
buffer 42, the first packet in the buffer 42 is read out and moved to the jacket store 44. 
Necessary information of the packet is sent to a scheduler 45 at the same time. 

5. The scheduler 45 checks whether ouq>utting of the packet in the packet store 
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44 will overflow the transport buffer 87 of the corresponding elementary stream decoder 8S 
(Fig. 5) and signals it to a MUX 47. 

6. If the packet store 44 has a packet and the scheduler 45 signals that the 
decoder transport buffer will be OK, the MUX 47 selects and reads out the transport packet 

5 in the packet store 44. Otherwise, the MUX 47 selects and outputs a Null packet from a 
Null packet generator 49. The packet in the packet store 44 remains there until it is read 
out. 

7. Each PCR value in the transport packet transmitted by the MUX is modified 
in a PCR restamper SO using the following equation: 

10 PCR„^^ - PCR^id -f (Clock^urrcm ' Clock^^^) - Delay^ (1) 
where, 

PCR„^^^ : New PCR value after restamping; 

PCR^i^j : Old PCR value before restamping; 

Clock^u^Qt * Current Clock value at output time restamping SO; 
IS Clockja^^ : Clock value tagged 41 at reception of the packet; 

Delay : Maximum delay through the remux operation, which is a constant value to ensure 

that each PCR value never increases. 

The scheduling scheme is an important feature of this invention. The main 

purpose of scheduling is to ensure that the transport buffers in the decoders never overflow. 
20 Scheduling of packets takes a lot of work if it is done in a brute force manner because it 

involves keeping track of the transport buffer fullness of every elementary stream in parallel. 

This may be too complicated for consumer applications apparatus, hence, we created a 

simpler way to do the job. This is based upon the foUowing: 

1. We can derive the transport buffer (8S-88 in Fig. S) emptying or leak rate 
25 (read-out rate) of each elementary stream from the information carried in the input transport 

stream. For example, the transport buffer leak rate is S4 Mbps for the Grand Alliance HD 

Video standard, 18 Mbps for SD Video and 2 Mbps for Audio, etc. We can know that if tfie 

remux rate is less than the transport buffer leak late, no transport buffer monitoring is 

necessary because the transport buffer never overflows. Hence, we can reduce the number 
30 of transport buffers that we need to monitor. Transport buffer monitoring can be further 

simplified using the following ai^roa^es: 

1. The buffer fidlness of each transport buffer increases monotonically from the 

begirming of each recaved packet through ttie end of the packet; hence, we need to check the 

buffer fullness only at the end of each |Kicket. 
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2. Remux knows its own output transport rate (the remux rate) as well as the 
transport buffer leak rates for each elemratary stream; hence» it can know how much the 
buffer fullness of a transport buffer will change by s&iding a packet and by not sending a 
packet to the tran^n buffer, using the following equations: 

5 Leak = • Tp^ket (2) 

Delta = - Leak (3) 

where, 

t ^^if : Change of transport buffer fullness per one-packet pehod when transport buffer 
receives no packet; 
10 R|cak • transpon buffer leak rate; 

Tpackei ■ PaC^e^ period, i.e., Sp^j^et/Rremux: 

Spackil " Packet size; 
J^remux • R^mux rate; 

Delta : Change of transport buffer fullness per one-packet period when transport buffer 
IS receives one packet. 

Table 1 below shows an example of a parametm table that can be used for 
transport buffer monitoring. 

£atEieak l^al£ DcUa 

bits fbvtes^ b»t5 fbylgS) 

20 SD 18 Mbps 1,082(135) 422 (53) 

Audio 1 Mbps 61 (8) 1,443 (180) 

Others ^R^mux *^PS NA or 0 NA or 0 

(Spi«:ket = 188 bytes, R„„^^ = 25 Mbps) 

This table can be expanded if there are other data types which have known transport buffer 
25 leak rates and require transport buffer monitoring. 

3. Using the above results, the buffer fullness of each transport buffer can be 
calculated using the following equations: 

Bp„v = Bta«(i) - Leak(i)(Ce„„«,t " Cia^Ci) - D (4) 
where, 

30 i : Index of the elementary stream which the current packet belongs to; 

Bp^v : transpon buffer fullness of the i-th elementary stream just before receiving the current 
pack^; 

B|^i) : tran^rt buffer fiiUness of the i-tfa elraientary stream udien the transport buffer has 
just finished receiving the last packet; 
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Leak(i) : tianspon buffo- leak xate of the i-th elemoitary stream per one packet period; 
^cumnt - Value of ouQ>ut packet counter for the current packet; 

Cto«(i) : Value of ouq>ut packet counter for the last packet of the i-th elementary stream 
I'^Bprev < 0, then Bj^^ = 0 (5) 
5 ^c^t = Bp„^ + Delta(i) (6) 

where, 

^current • transport buffo- fullness of the i-th elementary stream when the transport buffer has 
just finished receiving the current packed 

Delta(i) : Change of transport buffer fullness of the i-th elementary stream by receiving one 
10 packet. 

The scheduling algorithm goes as follows in the preferred embodiment: 
SICBJ.. At every interval Tj^^,, check if a whole packet is in the packet store 
44. If there is a packet (the current packet), go to Step 2, otherwise, go to Step 5. 

&ISIL2. If the transport buffer leak rate of the i-th elementary stream, to which 
15 the current packet belongs, is obtained for flie first time, calculate Leak(i) and Delta(i), using 
equation (2) and equation (3), respectively, and initialize the parameters for transport buffer 
monitoring as follows, and go to Stq> 3: 

= 0 (7) 

20 SlSSLl- Calculate Bg^^m corresponding to the current packet, using equation 

(4), equation (5) and equation (6), and go to Step 4. 

Stgp 4. ^f^cnmat equal to or less than the transport buffer size, output the 
current packet and update the parameto-s as follows and go to Step 6. Otherwise, go to Step 

5: 

= Cg„^ . (10) 
SSSSlI. Oatpat a Null packet and go to St^ 6. 

SlQL^. Increment die ouq>ut packet counter as follows and go to Stq> 1: 

^current ~ ^eurreiit ' (11) 
^ l^s simple scheduling scheme requires only a series of simple calculations per 

each packet period regardless of die numbo of the elementary streams in the transport 
stream and yet can prevent tranqxirt buffer overflow from happening. Moreover, as will be 
appreciated, where the system of Fig, 6 is employed as the packet processor of Fig. 5, it is 
cap^le of monitoring the buffer fullness in each of the target decoders 85 provided while 
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delivering to them valid MPEG streams. This is because the above-noted algorithm can be 
executed each time a packet arrives at the store 44, because the scheduler 45 knows which 
data stream the packet belongs to, is keeping track of the packets of eadi separate data 
stream, and knows the leak rates of the respective transport buffers in the respective target 
decoders 85. Thus, in a serial packet processing system, a single scheduler is able to 
monitor multiple decoders. 

If we combine the remuxing scheme explained above in connection with Fig. 3 
with the overall recording proposal described in the referenced copending application, and 
remove redundancy, we can obtain a total DVCR solution, which is illustrated in Fig 7. The 
same reference numerals as are used in Figs. 1 and 6 r^resent the same components in Fig. 
7. The new components which function similarly to those previously described include a 
packet sequencer tagger 60 corresponding to the tagger 10, a second local buffer B 
corres]x>nding to local buffer 15, and a MUX 62 which muxes tagged and restamped 
transport packets with the trickmode and null packets in the recording part prior to recording 
on the media. Whereas the previous Null packets meant MPEG Null packets to create a 
valid MPEG stream, these null packets 49 are used merely to fill gaps in the recorxiing 
stream and serve no MPEG function. In the playback part, there is provided a filter 65 that 
serves to strip off undesired fill packets and the resultant transport stream is stored in a local 
buffer C 66 corresponding to local buffer 22, a decoding packet store 67 and decoding 
scheduler 68 which performs the reverse functions of the scheduler 45 in the encoding part, 
and a MUX 69 corresponding to block 17. 

Recording then goes as follows: 

h The necessary packets are selected by the filter 40. 

2. The packets containing PGR are tagged 41 with the local clock 39. 

3. Each f)acket is stored and kept in local buffer A 42 until it is read out. 

4. Whenever the packet store 44 is empty and there is at least one packet in 
buffer A 42, the first packet in buffer A 42 is read out and moved to the packet store 44. 
The necessary information of the packet is sent to the scheduler 45 at the same time. 

5. The scheduler 45 checks whether outputting the packet in the packet store 44 
will overflow the target transport buffer of the corresponding elementary stream or target 
decode, as described above, and signals it to the MUX 62. 

6. If the packet store 44 has a packet and the scheduler 45 signals that the target 
transport buffer will be OK, the packet in the pactet store 44 is read out. The packet in the 
packet store 44 remains there imtil it is read out. 
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7. Each packet containing PCR is restamped 50 its PCR value using equation 

(1). 

8. Each packet is tagged 60 with its packet sequence No., which may have 
discontinuity due to the scheduling. 

9. Each packet is sxored and k^t in the local buffer B 61 until it is read out. 

10. The packets read out from the buffer B 61 are multiplexed 62 witti 
trickmode packets 16 and, if necessary, null packets 49, according to a trickmode recording 
scheme. 

Playback goes as follows: 

1. The necessary packets are selected by the; filter 65. 

2. Each packet is stored and kept in the local buffer C 66 until it is read out. 

3. Whenever the packet store 67 is empty, a packet is read out from the buffer 
C 66 and moved to the packet store 67. The Packet Sequence No. tag of each packet is sent 
to the scheduler 68. 

4. The scheduler 68 checks whether the Packet Sequence No. matches an 
internal packet coimter (not shown or incorporated in the scheduler) and signals OK if both 
match. 

5. If the scheduler 68 signals OK. the MUX 69 selects and reads out the packet 
in the packet store 67. Otherwise, the MUX 69 selects and sends out a NuU packet. Every 
packet is sent out at the remux rate. Fig. 7 thus combines the remux scheme of Fig. 6 with 
the necessary components to allow recording and playback from a DVCR. 

Figs. 9A and 9B show the improvement obtained under the same conditions 
described above in connection with Figs. 8A and 8B, respectively. In essence, shown in 
Fig. 9A, the rescheduler has delayed blocks 7 and 10, etc. (see arrows 75 and 76) long 
enough to prevent target buffer overflow. Similarly, blocks 6 and 9, etc. have been delayed 
at arrows 77 and 78 as shown in Fig. 9B to prevent overflow and loss of information. 

In this way, a DVCR can reconstruct at playback, without loss of information, 
a transport stream that has the rate and timing exactly as scheduled by the remux at 
recording. With this scheme, the remux rale can be equal to or higher or lower than the 
recording rate as long as the net tran^rt stream rate at the remux is equal to or less than 
the recording rate. Note that in the Fig. 6 embodiment, Null packets 49 are added. If 
substituted for the remuxer 80 in the Fig. 3 embodiment. Null packets would have to be 
deleted 82. This superfluous addition and deletion of MPEG Null packets is avoided in the 
Fig. 7 embodiment. 
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In the block diagrams of the figures, only the data flow is shown by the anx>ws. 
Those skilled in the art will understand that several of the blocks are interconnected for 
command and control signals that are not shown in the figure. 

As previously indicated, the invention is also applicable to other data formats 
S and othor ways of preserving the critical timing data. It will also be s^reciated that the 
circuitry and hardware to implement the various blocks shown, including software to the 
extent needed, will be evidrat to those skilled in the art not only from the detailed 
information supplied in the referenced related applications, but also from the below listed 
references, whose contents are also incorporated herein by reference: 



10 (1) European patent application no. 492,704 (PHN 13.546) 

(2) European patent application no. 93.202.950 (PHN 14.241) 

(3) European patent application no. 93.20L263 (PHN 14.449) 

(4) Grand Alliance HDTV System Specification, Draft document, February 22, 
1994, 

15 (5) US patent specification no, 5,142,421 (PHN 13.537) 

While the invmtion has been described in connection with preferred 



embodiments, it will be understood that modifications thereof within the principles outlined 
above wiU be evident to those skilled in the art and thus the invention is not limited to the 
preferred embodiments but is intended to encompass such modificadons« 
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CLAIMS: 



1- A method of processing a first transport stream of transpon packets of valid 

timing-critical-information, and of unknown transport rate that may be of varying rate or 
bursty, to form a second transport stream of transport packets of known <^nstant rate and of 
valid timing-critical-information, said second transport stream being supplied to and 
5 consumed by at least one target apparatus having a target buffer with a known read-out rate, 
comprising the steps: 

(i) providing a packet scheduler and providing to the scheduler the leak rate of 
the target buffer, 

(ii) processing the transport packets of the first transport stream in a serial 
10 manner through the scheduler to produce the second transport stream, said scheduler 

monitoring the target buffer and delivering the transport packets in the second transport 
stream to the target buffer timed so as not to overflow the target buffer. 
2. A method as claimed in claim 1, further comprising the step: 

(iii) modifying the timing-critical-information in the transpon packets of the 
15 second transport stream to take into account the processing delays encountered in stq> (ii). 

3- A method as claimed in claim 1, further comprising an asynchronous channel 

located downstream of the scheduler and before the target bu^er, said scheduler delivering 
the second transport suream to the targ« buffer via the asynchronous channel. 
^- The method of claim 3, wherein the first transpon stream is an MPEG data 

20 stream, and the channel is a digital VCR* 

5- A method as claimed in claim 1, further comprising at least some of the packets 
in the first transpon stream having a PGR, and restamping those packets with a new PGR at 
the time the second transpon stream is formed. 

6- A method of processing a first transpon stream of transpon packets having a 
25 PGR comprising plural bits representing valid timing-critical-information, and of unknown 

transpon rate that may be of varying rate or bursty, to form a second transpon stream of 
transpon packets of known constant rate and of valid timing-critical-information, comprising 
the stq>s: (i) providing a local clock, 

(ii) processing the transpon pack^ of the first transpon stream in a serial 
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maimer while sampling the local clock whoi a bit of the PCR of each packet is processed 
and storing the sampled clock time for each packet, 

(iii) delaying the transport packets to avoid overflowing downstream buffers, 

(iv) when ready to deliver the transport packets without overflowing the 

5 downstream buffer, re-sampling the local clock at the time of the corresponding PCR bit and 
updating the PCR with the new sample time, 

(v) delivering the transport packets with updated PCRs to form the second 
transport stream. 

7. The method of claim 6, wherein the transport rate of the first transport stream 
10 is of the order of 50 Mbps and the transport rate of the second transport stream is of the 

order of 25 Mbps. 

8. A method of transmitting timing-critical data including a program clock 
reference (PCR) via an asynchronous channel downstream to apparatus including a target 
buffer having a limited read-out rate, comprising the steps: 

IS (i) receiving the timing-critical data subdivided into a stream of successive 

transpon packets, 

(ii) determining the arrival time of each of the transpon packets, 

(iii) temporarily storing the transport packets, 

(iv) computing the times when individual transport packets can be transmitted 
20 downstream to avoid overflowing the target buffer, 

(v) computing the departure time of each of said transport packets and 
modifying the PCR accordingly, 

(vi) transmitting downstream the transport packets in accordance with the 
computations of step (iv). 

25 9. A method as claimed in claim 8, further comprising re-stamping the transmitted 

transport packets, before transmission, with a new PGR. 
10. A method as claimed in claim 8, further comprising: 

(1) selecting the desired packets from the incoming transport stream by a filter, 

(2) storing for the selected packets the sampled arrival time of a local clock, 
30 (3) storing the sele ct ed transport packets via a local buffer in a packet store, 

(4) whenever the packet store is empty and there is at least one packet in the 
local buffer, readirig out the first packet in the local buffer and moving same to the packet 
store while simultaneously passing on to a scheduler information concerning the packet, 

(5) computing in the scheduler whether ou^utting of the packet in the packet 



NSOOOD: 4MO_JBeoei1CA1JL> 



10 



wo 96/08115 PCT/IB9SA)0715 

17 

store will overflow the downstream target buffer and signalling it to a MUX, 

(6) if the packet store has a packet and the scheduler signals that the target 
buffer will be OK, selecting in the MUX and reading out the transport packet in the packet 
store; otherwise, selecting in the MUX and outputting a Null packet from a Null packet 
generator, 

(7) modifying the PCR in the transport packet transmitted by the MUX in a 
PCR re-stamper using the following equation: 

PCR^ = PCR^w + (Clockeu^^t - Clock^^) . Delay^ (1) 
where, 

'*CRaew : New PCR value after restamping; 
PCR^,,^ : Old PCR value before restamping; 
Clock^.„rrc2u • Current Clock value at restamping; 
Clockj^^^ : Clock value tagged at recq}tion of the packet; 

^^^ymax * Maximum delay through restamping, which is a constant value to ensure that 

IS each PCR value never increases. 

11- A method as claimed in claim 10, wherein said scheduler operates by knowing 

the read-out rate of the target buffer, by computing the downstream target buffer fullness at 
an output transport rate, and by delaying the transmission of any transport packets if the 
computation indicates that the target buffer will overflow. 

20 12. A method as claimed in claim 10, further comprising means to record the 

selected packets, further comprising the steps: 

(viii) tagging the transport packets having the modified PCR with a sequence of 
arrival (SOA) tag, 

(ix) transmitting the tagged packets to a recorder. 

25 13. Apparatus for generating from an incoming unknown first transport stream of 

transport packets having a PCR and of valid timing-critical-information a fixed-rate constant 
second transport stream comprising a sequence of transport packets comprising a PCR for 
delivery to a target buffer having a maximum read-out rate, comprising: 

(a) filter means for receiving the first transport stream for passing the transport 
30 packets desired to be included in the second transport stream, 
Q}) a local clock measuring time, 

(c) a transport packet store for receiving the packets of the first transport 

stream, 

(d) a schedulo^ for storing the maximum read-out rate of the target buffer, 
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(e) a first mux connected to the scheduler and to the transport packet store, 
(0 a source of Null packets connected to the first mux, 

(g) means in respond to the transpon packet store being empty and there being 
at least one transport packet available for moving said one transport packet to the transport 

S packet store, 

(h) said scheduler being operative to determine whether outputting the transport 
packet in the transport packet store will satisfy a first condition that it will not overflow the 
target buffer or a second condition that it will overflow the target buffer and signalling the 
first mux that the transport packet in the transport packet store will satisfy the first or the 

10 second condition, 

(i) said first mux being operative in response to the signalling from the 
scheduler of the first condition to select and read out the said transpon packet from the 
transpon packet store and output it and in response to the signalling from the scheduler of 
the second condition to select a Null pactet from the Null packet source and output it, 

15 (j) packet restamping means connected to the clock means and connected to 

receive the transpon packets outputted by the mux for re-stamping said transpon packets 
with a new PGR value. 

14. Apparatus as claimed in claim 13, further comprising a recorder, means to tag 

the outputted transpon packets with an SOA tag, means to record the tagged transpon 
20 packets. 
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